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(54) DEVICE AND METHOD FOR PROCESSING PICTURE SIGNAL 

(57)Abstract: 

PROBLEM TO BE SOLVED: To improve quality in a picture to be restored from a 
signal which is generated by compression encoding. 

SOLUTION: An input picture signal I restored from a compression picture signal is 
made into a block. A DCT(discrete cosine transformation) transforming circuit 32 
creates a DCT coefficient value based on the signal which is made into a block. The 
value where a space frequency is in a middle area and a high area is extracted among 
the DCT coefficient ones and dispersion values are calculated based on them. When 
at least one of the dispersion values is smaller than aTirst thresholda first flag is 
flagged. In the meantimean adjacent pixel extracting memory 33 extracts the group of 
pixels being adjacent across a block boundary. A differential absolute value between 
the pixels is calculated and the number of times where the calculated value 
continuously becomes larger than the second threshold is counted by a continuity 
counting circuit 43. When the counted value is larger than the third thresholdthe third 
flag is flagged. When the first and the third flags are simultaneously flaggedthe fourth 
flag indicating the position of a block distortion is flagged. 



CLAIMS 



[Claim(s)] 

[Claim 1]An image signal processor which removes block distortion from a picture 
signal acquired by performing decryption corresponding to compression encoding to a 
compression encoding picture signal characterized by comprising the following 



generated by compression encoding including orthogonal transformation. 

An orthogonal transformation means which carries out orthogonal transformation to a 

picture signal to input by making a two-dimensional block into a unit. 

A coefficient value set division means to divide into two or more fields a set of a 

coefficient value acquired for every pixel within the above-mentioned block as a 

result of the above-mentioned orthogonal transformation. 

A variance calculating means which calculates a value of distribution of an absolute 
value of the above-mentioned coefficient value in a specific field of one piece or 
plurality of two or more above-mentioned fields. 

[Claim 2]An image signal processor having further a variance comparison means to 
generate a comparison result signal which shows a comparison result measuring an 
output of the above-mentioned variance calculating means with a predetermined 
threshold in claim 1 . 

[Claim 3]An image signal processor using a field where spatial frequency is 

comparatively high as the above-mentioned specific field in claim 1. 

[Claim 4]An image signal processor having further a means to perform an operation 

based on an output of the above-mentioned variance comparison means respectively 

corresponding to the two above-mentioned fieldsin claim 1 using a field which is two 

pieces whose spatial frequency is comparatively high as the above-mentioned specific 

field. 

[Claim 5]An image signal processor which removes block distortion from a picture 
signal acquired by performing decryption corresponding to compression encoding to a 
compression encoding picture signal characterized by comprising the following 
generated by compression encoding including orthogonal transformation. 
An adjacent pixel extraction means to extract a group of two pixels in a position 
which divides a picture signal to input into a two-dimensional blockand adjoins 
mutually across a block border for every block. 

A difference absolute value calculating means which calculates a difference absolute 
value about a group of the above-mentioned pixel. 

[Claim 6]A difference absolute value comparison means to output a comparison result 
in claim 5 measuring an output of the above-mentioned difference absolute value 
calculating means with a predetermined thresholdcontinuity which outputs a 
comparison result measuring with a predetermined threshold an output of a continuity 
counting means which calculates the number of times to which the above-mentioned 
difference absolute value comparison means outputs a predetermined comparison 
result continuouslyand the above-mentioned continuity counting means — calculation 
— an image signal processor having a comparison means further. 
[Claim 7]Claim 2 comprising: 

An adjacent pixel extraction means to extract a group of two pixels in a position 



which divides a picture signal to input into a two-dimensional blockand adjoins 
mutually across a block border for every block. 

A difference absolute value calculating means which calculates a difference absolute 
value about a group of the above-mentioned pixel. 

A difference absolute value comparison means to output a comparison result 
measuring an output of the above-mentioned difference absolute value calculating 
means with a predetermined threshold. 

A continuity counting means which calculates the number of times to which the 
above-mentioned difference absolute value comparison means outputs a 
predetermined comparison result continuouslycontinuity which outputs a comparison 
result measuring an output of the above-mentioned continuity counting means with a 
predetermined threshold — calculation — having a comparison means further — an 
output of the above-mentioned variance comparing outputand the above-mentioned 
continuity — calculation — a means to perform data processing based on an output 
of a comparison means. 

[Claim 8]A picture signal disposal method which removes block distortion from a 
picture signal acquired by performing decryption corresponding to compression 
encoding to a compression encoding picture signal characterized by comprising the 
following generated by compression encoding including orthogonal transformation. 
An orthogonal transformation step which carries out orthogonal transformation to a 
picture signal to input by making a two-dimensional block into a unit. 
A coefficient value set division step which divides into two or more fields a set of a 
coefficient value acquired for every pixel within the above-mentioned block as a 
result of the above-mentioned orthogonal transformation. 

Variance calculation steps which calculate a value of distribution of an absolute value 
of the above-mentioned coefficient value in a specific field of one piece or plurality of 
two or more above-mentioned fields. 

[Claim 9]A picture signal disposal method which removes block distortion from a 
picture signal acquired by performing decryption corresponding to compression 
encoding to a compression encoding picture signal characterized by comprising the 
following generated by compression encoding including orthogonal transformation. 
An adjacent pixel extraction step which extracts a group of two pixels in a position 
which divides a picture signal to input into a two-dimensional blockand adjoins 
mutually across a block border for every block. 

Difference absolute value calculation steps which calculate a difference absolute 
value about a group of the above-mentioned pixel. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the image information converter and 
image information conversion method for restoring the picture signals set acquired by 
the compression encoding which includes orthogonal transformationsuch as MPEGfor 
example. 
[0002] 

[Description of the Prior Art]When the picture signals set acquired by compression 
encoding including orthogonal transformationsuch as MPEG1 and MPEG 2is 
restoredwith a high compression ratioblock distortion may be especially conspicuous 
in a reproduced image. Since this block distortion is conspicuous in a block borderthe 
method of reducing distortion is proposed by applying an accommodative low pass 
filter etc. to a block boundary portion. 
[0003] 

[Problem(s) to be Solved by the Invention]Howeverwhen processing which was 
mentioned above was performedthere was a problem that there was a possibility that 
the fall of the resolution which originates in low pass filter processing in the edge part 
contained in the original picture may arise. 

[0004]If the position of block distortionetc. are exactly detectableprocessing of 
applying a low pass filter only to the portion is attainedand dissolution or its extent 
can be reduced for an above-mentioned problem. 

[0005]Thereforewhen the purpose of this invention detects exactly the position etc. 
of the block distortion in the picture signal restored from the coded image signal 
generated by the coding including orthogonal transformationBlock distortion is 
removed exactly and it is in providing the image information converter and image 
information conversion method which can raise image quality. 
[0006] 

[Means for Solving the Problem]In an image signal processor which removes block 
distortion from a picture signal acquired when an invention of claim 1 performs 
decryption corresponding to compression encoding to a compression encoding picture 
signal generated by compression encoding including orthogonal transformationAn 
orthogonal transformation means which carries out orthogonal transformation to a 
picture signal to input by making a two-dimensional block into a unitln a specific field 
of one piece or plurality of a coefficient value set division means to divide into two or 
more fields a set of a coefficient value acquired for every pixel within the above- 
mentioned block as a result of the above-mentioned orthogonal transformationand 
two or more above-mentioned fieldslt is an image signal processor having a variance 
calculating means which calculates a value of distribution of an absolute value of the 
above-mentioned coefficient value. 



[0007]In an image signal processor which removes block distortion from a picture 
signal acquired when an invention of claim 5 performs decryption corresponding to 
compression encoding to a compression encoding picture signal generated by 
compression encoding including orthogonal transformationAn adjacent pixel extraction 
means to extract a group of two pixels in a position which divides a picture signal to 
input into a two-dimensional blockand adjoins mutually across a block border for 
every blocklt is an image signal processor having a difference absolute value 
calculating means which calculates a difference absolute value about a group of the 
above-mentioned pixel. 

[0008]In a picture signal disposal method which removes block distortion from a 
picture signal acquired when an invention of claim 8 performs decryption 
corresponding to compression encoding to a compression encoding picture signal 
generated by compression encoding including orthogonal transformationAn orthogonal 
transformation step which carries out orthogonal transformation to a picture signal to 
input by making a two-dimensional block into a unitln a specific field of one piece or 
plurality of a coefficient value set division step which divides into two or more fields a 
set of a coefficient value acquired for every pixel within the above-mentioned block 
as a result of the above-mentioned orthogonal transformationand two or more above- 
mentioned fieldslt is a picture signal disposal method having the variance calculation 
steps which calculate a value of distribution of an absolute value of the above- 
mentioned coefficient value. 

[0009]In a picture signal disposal method which removes block distortion from a 
picture signal acquired when an invention of claim 9 performs decryption 
corresponding to compression encoding to a compression encoding picture signal 
generated by compression encoding including orthogonal transformationAn adjacent 
pixel extraction step which extracts a group of two pixels in a position which divides a 
picture signal to input into a two-dimensional blockand adjoins mutually across a 
block border for every blocklt is a picture signal disposal method having the difference 
absolute value calculation steps which calculate a difference absolute value about a 
group of the above-mentioned pixel. 

[0010]According to claim 1 and the invention according to claim 8a high block of a 
possibility of having block distortion based on a variance in a conversion factor 
obtained by performing orthogonal transformation to a picture signal is detected. 
[001 1]According to claim 5 and the invention according to claim 9a high block of a 
possibility of having block distortion based on a difference absolute value of picture 
element data between pixels which adjoin across a block border in a picture signal is 
detected. 
[0012] 

[Embodiment of the Invention]The composition of one embodiment of this invention is 
explained with reference to drawing 1 . The input picture signal I is supplied to A/D 
converter 30. Herethe input picture signal I is the usual television signal acquired by 



restoring the picture signals set with which it comes to give compression encoding 
which contains discrete cosine transforms (it is hereafter written as DCT 
transformation)such as MPEG1 and MPEG 2in an original picture signal by the 
decoder which is not illustrated. A/D converter 30 performs and digitizes an AD 
translation to the input picture signal L The output of A/D converter 30 is supplied to 
the blocking circuit 31 . The blocking circuit 31 blocks the output of A/D converter 30 
to two-dimensional DCT blockssuch as 8 pixels x 8 pixels. Herethe operating 
condition of the blocking circuit 31 is controlled so that the block border of DCT 
blocks is made into the same position as the block border of the DCT blocks in the 
case of compression encodingsuch as MPEG1 and MPEG 2. 
[0013]The output of the blocking circuit 31 is supplied to the DCT transformation 
circuit 32 and the memory 33 for adjacent pixel extraction. The DCT transformation 
circuit 32 performs DCT transformation processing to the output of the blocking 
circuit 31 and generates a DCT coefficient value. Although the case where a coding 
mode including DCT transformationsuch as MPEG1 and MPEG 2was here used as 
original compression encoding was considered as composition provided with the DCT 
transformation circuit 32This invention can be applied when using the coding mode 
which includes orthogonal transformation other than DCT transformationsuch as a ■ 
Hadamard transformfor example as original compression encoding. In such a casewhat 
is necessary is just to have composition provided with the circuit which performs 
orthogonal transformation included in the original compression encoding instead of the 
DCT transformation circuit 32. 

[0014]The DCT coefficient value generated by the DCT transformation circuit 32 is 
divided according to spatial frequency. For exampleit is divided into four fields 
including a DC valuelow-passa mid-rangeand a high region as shown in drawing 2 . 
Among the fields of these pluralitythe DCT coefficient value in the field where spatial 
frequency is comparatively high is extracted. When performing division as shown in 
drawing 2 a mid-range and the coefficient value of a high region are extracted by the 
mid-range extracting circuit 34 and the high region extracting circuit 35respectively. 
Hereprocessing based on the DCT coefficient value in the field where spatial 
frequency is comparatively high is performed because it took into consideration that 
it was easy to produce block distortion. Howeverthe number of the fields divided is 
not limited to four piecesand the number of the fields extracted is not limited to two 
pieces. 

[0015]The output of the mid-range extracting circuit 34 and the high region extracting 
circuit 35 is supplied to an absolute valueaverage valueand the variance calculation 
circuits 36 and 37respectively. An absolute valueaverage valueand the variance 
calculation circuits 36 and 37 calculate an absolute valueaverage valueand a variance 
based on the signal supplied. The variance which an absolute valueaverage valueand 
the variance calculation circuits 36 and 37 computerespectively is supplied to the 
comparison circuits 38 and 39. The 1st threshold is separately supplied to the 



comparison circuits 38 and 39. And the comparison circuits 38 and 39 supply a 
comparison result to the flag generating circuit 40comparing the variance supplied 
with the 1st threshold. 

[0016]The flag generating circuit 40 sets the 1st flag that shows that he is a block 
distortion candidate on an output signalwhen at least one side of the outputs of the 
comparison circuits 38 and 39 is a comparison result of the purport that a variance is 
smaller than the 1st threshold. When the variance to which the comparison circuits 38 
and 39 are supplied is smaller than the 1st thresholdit is made for such operation to 
output '1' as a comparison resultand it is realized by the composition of using an 
alternation gate as the flag generating circuit 40. The output of the flag generating 
circuit 40 is supplied to the memory 45 for timing adjustments. 

[0017]On the other handthe memory 33 for adjacent pixel extraction once memorizes 
the blocked picture signal which is an output of the blocking circuit 31 and supplies 
the group of the picture element data which adjoins mutually across a block border to 
the difference absolute value calculation circuit 41 by outputting controlling an 
address appropriately after that. 

[0018]The group of the picture element data which adjoins mutually across a block 
border is explained with reference to drawing 3 . In drawing 3t he block border where a 
thick line consists of 8 pixels x 8 pixels is shown. The numerals of 123. ..28 were 
clockwise given to the pixel within the block in the position which adjoins a block 
border, and the pixel of the outside of the block border which adjoins to each of the 
pixels 123... 28 — 12and 3 ... was attached, however — since two pixels of the outside 
of a block border adjoin to the pixels 181 Sand 22 located in four corners of a block — 
respectively — the pixels 1 and 1 — "the pixels 8 and 8'and the pixels 15 and 15 — it 
illustrated so that "and the pixels 22 and 22' might adjoin. 

[0019]The difference absolute value calculation circuit 41 computes the absolute 
value of difference about the group of the picture element data which adjoins mutually 
across a block border supplied from the memory 33 for adjacent pixel extractionand 
supplies the absolute value of the computed difference to the comparison circuit 42. 
The 2nd threshold is separately supplied to the comparison circuit 42. And the 
comparison circuit 42 supplies a comparison result to the continuity counting circuit 
43comparing the absolute value of the difference supplied with the 2nd threshold. 
When judged with the comparison circuit 42 having an absolute value of difference 
larger than the 2nd thresholdmore specificallythe 2nd flag is set on the signal which 
shows a comparison result. 

[0020]The continuity counting circuit 43 calculates the number which the 2nd flag 
follows the output of the comparison circuit 42and appearsand supplies enumerated 
data to the comparison circuit 44. The 3rd threshold is separately supplied to the 
comparison circuit 44. And when judged with enumerated data being larger than the 
3rd thresholdthe comparison circuit 44 sets the 3rd flag that shows that he is a block 
distortion candidate on an output signal. The output of the comparison circuit 44 is 



supplied to the memory 45 for timing adjustments. 

[0021]The memory 45 for timing adjustments once holds the output of the flag 
generating circuit 40and the output of the comparison circuit 44and after it doubles 
both timingit supplies them to AND gate 46. AND gate 46 sets the 4th flagwhen the 
1st flag in the output of the flag generating circuit 40 and the 3rd flag in the output of 
the comparison circuit 44 stand simultaneously. Such 4th flag will show the block with 
a higher possibility that block distortion has arisen. The block distortion reduction 
circuit which the 4th flag does not illustrate is supplied. 

[0022]In a block distortion reduction circuitprocessing which pinpoints the occurrence 
position of block distortion with reference to the position which stands as for the 4th 
flag is performedand processing for removing block distortion based on a processing 
result is performed. That isin relation to the occurrence position of the block 
distortion specifiedthe processing condition in low pass filter processing and class 
sorting adaptation processing is controlled (for examplechange of processing 
parameterssuch as a change of prediction coefficient datachange of tap structureetc). 
[0023]The flag based on the variance calculated in one embodiment of this invention 
mentioned above based on the output of the DCT transformation circuit 32 (generally 
orthogonal transformation circuit)He is trying to generate the flag which shows the 
block which has block distortion based on both flags based on the difference absolute 
value between the pixels which adjoin across a block border. On the other handit may 
be made to use it as a flag which shows the block which has block distortion for the 
flag based on the variance calculated based on the output of an orthogonal 
transformation circuit. It may be made to use it as a flag which shows the block which 
has block distortion for the flag based on the difference absolute value between the 
pixels which adjoin across a block border. 

[0024]Various modification and application are possible for this invention within limits 
which are not limited to the embodiment etc. which were mentioned above and do not 
deviate from the main point of this invention. 
[0025] 

[Effect of the Invention]To the conversion factor obtained by performing orthogonal 
transformation to the picture signal which may have block distortion according to this 
invention as mentioned abovea varianceAnd/orthe high block of a possibility of having 
block distortion based on the difference absolute value of the picture element data 
between the pixels which adjoin across the block border in a picture signal is detected. 
[0026]Since processing for reducing block distortionsuch as low pass filter 
processingfor example can be performed more exactly by thisimage quality can be 
raised. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a block diagram showing an example of the composition of one 
embodiment of this invention. 

[Drawing 2] It is an approximate line figure for [ of a DCT coefficient value ] giving 
area division explanation. 

[Drawing 3] It is an approximate line figure for explaining the pixel which adjoins across 
a block border. 
[Description of Notations] 

32 [ The memory for adjacent pixel extraction 41 / ... A difference absolute value 

calculation circuit43 / ... Continuity counting circuit ] ... A DCT transformation 
circuit3637 ... An absolute valueaverage value and a variance calculation circuit3839 ... 
A comparison circuit33 
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